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ABSTRACT 

\ The program for gifted and talented students in the 

Austin Independent School District consists of 126 programs in grades 
\ K-12 to develop skills and abilities in academic subjects, music, 
art, problem-solving, and coping with giftedness. The program has 
been in effect since 1975. The focus of the evaluation in 1981-82 is 
\ the identification of program characteristics and unique features 
from which subsequent changes can be studied. The evaluation will 
■ also provide formative data, e.g., which components of the present 
program, if any, should be modified or deleted; and whether any 
components should be added. The relevant evaluation questions and 
objectives, the information sources to provide evaluation data, and 
the program information needs are described. Curriculum development 
and achievement are secondary evaluation interests. (CM) 
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Evaluation Design 



ABSTRACT 



Title : Evaluation Design: 1981-82 Program for the Gifted and Talented 
Contact Person : Angela Ladogana, Jonathan Curtis 
No. Pages : 16 . * 



This year's evaluation of the Gifted and Talented Programs in Austin is 
primarily exploratory in nature. The focus is on the identification of 
the program's genei'al characteristics and unique features. Curriculum 
Development and achievement rfre secondary interests addressed by this 
design. 



Summary : 
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EVALUATION DESIGN REVIEW FORM 



A copy of relevant portions of this design will be provided to the follow- 
ing p&nsons for review and comment : 



Ms, Terry Masters 

Coordinator, Program for the Gifted and Talented 
Dr. Susan Dollar 

Manager for Staff Development, Program for the Gifted and Talented 
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II A 

PROGRAM SUMMARY 



The program for gifted aid talented students in the Austin Independent 
School District has been in effect since 1975. This year, the program 
consists of 126 programs in grades K-12 in Various areas of giftedness. 

The chief purpose of the program is to develop\the skills and abilities 
of gifted and talented students in: 

• academic subject areas 

• music 
» art 

• high-level thinking processes**? - , , - , 

° , , , , , , \as applied to problem-solving 

• creative productive thinking J 

• leadership styles as applied in a variety of settings 

• coping with the special problems of being gifted 

Specific program objectives are: 

• to establish a continuous identification and exiting 
process, so that students may enter or exit a gifted 
program at any time throughout the school year. 

• to provide administrators, teachers, counselors and 
* librarians with in-depth training and awareness in 

gifted education. 

• to develop curriculum which incorporates high-level 
thinking and creative/productive thinking skills. 

• to develop curriculum for students gifted in leader- 
ship/psychosocial abilities. 

• to increase parent and community awareness of the 
goals and activities of the programs for gifted and 
talented students, so as to facilitate and encour- 
age their involvement . 

• to develop an evaluation design so as to determine 
to what extent program goals, objectives and acti- 
vities are being achieved. 
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MB 

EVALUATION SUMMARY 



The primary focus of this evaluation is the identification of charac- 
teristics and unique features of the Gifted and Talented Programs. 
Such information will provide a baseline from which subsequent charges 
can be evaluated. 

Secondary interests addressed by the Evaluation Design are Instructional 
Materials, Community and Parental Involvement, and Staff Development. An 
additional interest is whether there is any decrease in achievement associ- 
ated with spending time out of the regular classroom. 
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DECISION QUESTIONS ADDRESSED 



A. Accountability - Level Decision Questions 

Dl. What program characteristics are relevant and/or required, 
by the funding source? 

B. Project - Level Decision Questions 

D2, What components of the present District effort, if atty, 
should be modified or deleted? Should any ^components 
be added? 
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DECISION QUESTIONS OVERVIEW 
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DECISION QUESTION 


DECISION 
DATE 


DATE 
NEEDED 


v RELEVANT EVALUATION 
QUESTIONS & OBJECTIVES 


INFORMATION SOURCES 

■ j 








Nature of the Program 




Dl. What program characteristics are 
relevant and/or required by the 

f" • irwl K ti a aniirrp? 

i tlllU HIK OUULtC 1 




June 15 , 1982 


Dl-1 What are the programme gen* 
eral characteristics and 
* \ unique features? (To in- 
clude, itema such as entry/ 
exit criteria; subject/abil- 
it) **eas served, etc.) 


Program Plans; documentation from Pro- 
ject Coordinator's Office; Teachers 

* 


0 

D2. What components of the present 

District effort, if any p should be 
modified or deleted? Should any 
components be added? 




June 15 


Program Components 

Academic Achievement 

D2-1 Has the program impacted 
high-level thinking and 
creative/productive think- 
ing skills? (Pilot programs, 
Harris , Ortega) 


Student performance on pre-post tests: 

• Torrance Tests of Creativfc Thinking; 
Jeacher Interview; Student Nluest ion- 
uaire * 

• Other, if available * 






June 15 


D2-2 Has the program t ^acted 
leadership/pp\ »csocial 
, abilities in the elpmentnry 
and secondary grades? ( In 
pilot programs) 


Names on file* of students participating 
in leadership programs; listing of stu- 
dent projects.. 






June 15 


D2-3 How do students in programs 
, for the academically gifted 
perform on the District's 
standardised achievement 
test. 


Achievement test scores 
• ITBS (Grades 1-8) t , [ C 
STEP (Grades 9-12) 

<-» 

•> 
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DECISION QUESTIONS OVERVIEW 



DECISION QUESTION 


DECISION 
DATE 


DATE 
NEEDED 


RELEVANT EVALUATION 
QUESTIONS & OBJECTIVES 


INFORMATION SOURCES 








Curriculum 








June 15 


D2-4 What school and community 
resources are available to 
the teachers of Gifted/Tal- 
ented Programs?... Are 
teachers awars of these re- 
sources?... Do teachers 
utilize these resources? •• . 
What materials are most 
helpful?. .. What materials 
are needed? 


Teacher Interview; Program Plan; list 
of resources on file. 

X/ 


- 




June 15 


D2-5 Do students feel that their 
program has helped them ac- 
quire new skills and learn 
about additional resources 
in their particular subject 
area? 

Community and Parental Involvement 


.Student Interview; Student Question- 
naire; Teacher Interview 






i 


D2-6 In what ways has the program 
% made parents and the commu- 
nity aware of program goals 
and activities? 

D2-7 In what ways do parents and 
the community interact with 
school personnel? 

Staff Development* 

D2-8 In what ways does the staff 
support the program? 


Parent Questionnaire; Staff Records. 

Parent Questionnaire; Teacher Interview; 
Staff Records, 

Staff Interview 
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DECISION QUESTIONS OVERVIEW 



DECISION QUESTION 


DECISION 
DATE 


DATE 
NEEDED 


RELEVANT EVALUATION 
QUESTIONS & OBJECTIVES 


INFORMATION SOURCES 








D2-9 In what areas does the 

staff support the program? 

D2-10 What areas of training pro- 
vided by the program does 
the staff perceive as most 
beneficial? 

* These questions will be addressed 

if hiirlocat* anH Hmp onnftfminfft 

X l, UUU^Cl allU L XUIC LUIIOLiaAIILD 

allow, 

« 


Staff Interview, 
Staff Interview. 

\ 
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IVA 

INFORMATION NEEDS 



11. Identification of Gifted and Talented Programs and number of stu- 
dents served by these programs. 

12. How many students entering Gifted and Talented Programs complete 
the program? How many students exit the program during the year? 

13. How do parents, teachers arid students perceive the progress of stu- 
dents in Gifted and Talented Programs? 

14. What nomination and screening devices are being used the most by 
Gifted and Talented Programs? 

15. General program information and maintenance of student longitu- 
dinal files. 
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IV B 

INFORMATION NEEDS OVERVIEW 



INFORMATION NEED 



DATE 
NEEDED 



INFORMATION SOURCES 



11. Identification of Gifted and Talented 
Programs and number of students served 
by these programs. 

12. How many students entering Gifted and 
Talented Programs complete the program? 
How many students exit the program? 

13. How do parents, teachers and students 
perceive the progress of students in 
Gifted. and Talented Programs? 

14. What nomination and screening devices 
are being used the most by Gifted and 
Talented Programs? 

15. General program information and main- 
tenance of student longitudinal files • 



March '82 
June ! 82 



Jan. '82 
June '82 



June '82 



Jan. ! 82 



June '82 



Count of Gifted and Talented Program plans submitted 
for the 1081-82 school year; Gifted and Talented Pro- 
gram Roster. 

Gifted and Talented Program Roster. 



TEA Evaluation Forms GT 4,5,6; 



Gifted and Talented Program Plans, 



Gifted and Talented Program Plans; Gifted and Talent- 
ed Master File. 
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V 



DISSEMINATION 



INFOPMATION 



1. Evaluatipn Design" for 1981-82 



2. Evaluation Findings 1981-82 
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DISSEMINATION 
FORMAT 



Outline of the 
1981-82 Evalua- 
tion Design 

a) Final Report 

b) Final Techni- 
cal Report 



DATE 
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11/15/81 



07/01/82 



PERSONS 
RECEIVING 



Program Staff 



School Board, 
Program Staff, 
TEA 




INFORMATION SOURCES 



INFORMATION 
SOURCE 


POPULATION 


EVALQURS. 
REFERENCED 


DATE 
COLLECTED 


ANALYSIS 

TCPUMini IPC 


REMARKS 


(i) 


Torrance Tests of Crea- 
tive Thinking 


Students In Pilot Programs 
at Ortega and Harris 


D2-1 




April 


•82 


Time Series Regression 
Analysis 






f TI1C 
I 1 lid 


Students in Gifted and Tal- 
ented Programs, grades 1-8 


D2-3* 




April 


'82 


Descriptive Statistics 




( \ \ 
\ i) 


CT I/O 


Students in Gifted and Tal- 
ented Programs, grades V-12 


D2-3 




April 


'82 


Descriptive Statistics 




CO 


*Teacher Interview 


Gifted and Talented Program 
Teachers 


1)1-1, D2-1, 
D2-5, D2-7 


D2-4, 


April 


'82 


Descriptive Statistics 




(5) 


*Stttdt*nfc Questionnaire 


Students in Gifted and Tal~ 
ented Programs 


D2-1, D2-5 




April 


'82 


Descriptive Statistics 




(6) 


Program Plans 


NA 


Dl-1, D2-4 




Dec, 


'81 


Content Analysis and Desr- 
cripttve Statistics 




(7) 


Document nt Ion from 
Project Coordinator's 
Office 


NA 


Dl-i 




May 


'82 


Content Analysis and Des- 
criptive Statistics 




(*) 


A Parent Questionnaire 


ParenLs of students In 
Gifted and Talented Programs 


D2-5, D2-7 




April 


»82 


Pnn h nti h Anal ucl fl 




(9) 
(10) 


*Staff Interview 
Staff Records 


Staff In schools with a 
Gifted/Talented Program 


1)2-8, D2-9, 
D2-6, D2-7 


D2-10 


April 
April 


'82 
f 82 


Content Analysis 
Content Analysis 




(ID 


Listing of Student Pro- 
jects 


Students in PJ tot Programs 


D2-2 




April 


'82 


Content Analysis 




(12) 


Listing of Resources 




1)2-4 




April 


■82 


Content Analysis 





* To be addressed if budget and time constraints allow. 
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DATA TO BE COLLECTED IN THE SCHOOLS 



A. Students 

1. Torrance Tests of Creative Thinking 

2 . ITBS 

3. STEP 

"* 4. Student Questionnaire 

B . Teachers 

* 1. Teacher Interview 

2. Listing of Student Projects 

C. Other 

* 1. Staff Interview 

2. Staff Records 

3. Listing of Resources 

* 4. Parent Quescionnaire 



* Data will only be collected if budget and time constraints allow. 
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VIII 



EVALUATION TIME RESOURCES ALLOCATION 



00 





ACTIVITY 


DIRECTOR 


SENIOR 


EVALUATOR 


PROGRAMMER 


EVALUATION 


SECRETARY 








EVALUATOR 






ASSISTANT 




A. 


Evaluation Design 


1 


5 


15 






1 


B. 


Collection of Data 








• 


.-' 






1. Pre-post tests 






1 
1 










2. Torrance lests or Creative Thinking 






1 
1 










3. ITBS 


• 




1 










A . STEP 






1 










5. Teacher Interview 






• 2 










6. Student Questionnaire 






1 










7. Classroom Observation 






2 










8. Student Interview 






2 










9. Parent Questionnaire 






1 
1 










10. Staff Interview 






2 








C. 


Set up and maintenance of data base, 


1 


6 


20 


10 








longitudinal file 














D. 


Generating Questionnaires and Inter- 




1 
X 


2 










view Schedules 














E. 


Xeorxing Program Plans 












0 
L 


F. 


Analysis of Data 


1 


5 


20 


15 






G. 


Writing Final Reports 


2 


3 


20 






15 


H. 


Administrative and Other 


2 


4 


15 






5 




TOTAL 


— 1 

7 
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